Approved  for  OTS  release 


DDCIRA  D 


7 it  15-0  fl  D 


SUMMARY 


P-622 
1 0-10-5 t> 
-ii- 


\ 


In  a  game  of  survival,  two  players  with  limited  resources 
play  a  zero— sum  game  repeatedly  until  one  of  them  is  ruined. 

The  solution  of  the  survival  game  gives  one  a  measure  of  the 
value  of  resources  in  terms  of  survival  probabilities.  In  this 
paper  the  zero-sum  game  is  expressed  as  a  finite  matrix,  but 
with  (possibly)  incommensurable  entries;  hence  the  number  of 
different  distributions  of  resources  that  can  occur  during  a 
single  play  may  be  infinite.  The  existence  of  a  value  and 
optimal  strategies  is  proved,  usi ”g  the  theory  of  semi-martin¬ 
gales.  A  simple  approximation  to  the  solution  is  described,  and 
several  examples  are  discussed.  ( 
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Two  gamblers,  with  limited  resources  of  money,  agree  to 
play  and  replay  the  same  zero— sum  game  until  one  of  them  is 
ruined.  The  "game  of  survival"  that  results  is  similar  in  many 
respects  to  the  classic  "gambler's  ruin"  problem,  but  there  is 
one  important  difference  1  since  the  transition  probabilities 
are  controlled  by  the  participants,  and  not  by  chance,  there 
may  be  a  positive  probability  of  infinite  repetition,  with 
neither  gambler  being  ruined.  Thus,  to  save  oneself  and  to 
destroy  one's  opponent  are  somewhat  different  objectives;  in 
fact,  the  optimal  strategies  and  the  corresponding  probabilities 
of  ruin  or  survival  will  sometimes  be  found  to  depend  on  the 
value  assigned  to  the  case  of  double  survival. 

In  this  paper  we  propose  to  Investigate  thoroughly  those 
games  of  survival  where  the  underlying  "money"  game  is  given  by 
an  arbitrary,  finite  matrix  of  real  numbers.  The  existence  of 
solutions,  and  the  extent  to  which  they  depend  on  the  double- 
survival  payoff,  are  the  central  topics.  Our  approach  combines 
an  analysis  of  certain  game— theoretic  functional  equations  with 
the  theory  of  semimartingales.  A  number  of  examples,  and  methods 
of  constructing  and  approximating  the  solutions,  are  also  dis¬ 
cussed  . 

Previous  writings  on  the  subject  include  those  of  Bellman 
and  LaSalle  [}]  ,  Hausner  [ 1 0] ,  Pelsakoff  [  1 1 ] ,  and  Bellman  [1,2]; 

Portions  of  this  paper  were  presented  by  the  authors  at  a 
conference  on  "Recent  Developments  in  the  Theory  of  Oames"  in 
Princeton,  January  —  February  1,  1965 »  and  at  a  meeting  of  the 

Mathematical  Association  of  America  in  Seattle,  August  20-21,  196b. 
The  work  was  supported  by  the  RAND  Corporation  and  by  the  Office 
of  Naval  Research  oontract  Nonr-220(l6)  with  the  California  Institute 
of  Technology. 
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however,  only  certain  special  cases  have  so  far  been  examined 
rigorously.  Usually,  it  has  been  assumed  that  the  number  of 
accessible  "states"  (possible  distributions  of  money  during  the 
play)  is  finite.  It  should  be  remarked  that  under  such  restric¬ 
tions  survival  games  become  "recursive  games"  in  the  sense  of 
Everett  and  the  existence  of  a  solution  (assuming  a  constant 
double— survival  payoff)  becomes  a  simple  corollary  of  his  result 
[b] .  Mention  should  also  be  made  of  the  multi-dimensional 
survival  games  treated  by  Scarf  [ 1 2 j  ,  °nd  the  somewhat  similar 
multi— component  attrition  games  of  Blackwell  [4] . 


1.  QENKRAL  INTRODUCTION  AND  EXAMPLES 

Let  lla^jll  denote  the  matrix  of  the  "money"  game,  let  R 
be  the  sura  of  the  resources  of  the  two  players,  and  let  r^  be 
the  first  player's  initial  fortune.  Then,  if  player  I  chooses 
1^  on  the  kth  round  and  player  II  chooses  ,  the  new  level  of 
player  I's  fortune  is  given  by: 


(1) 


rk  " 


k-1 


+  a 


k  -  1,  2, 


a  formula  valid  so  long  as  0  <  r^_^  <  For  rk_i  outside  this 
interval  we  define  r^  •  r^_^ ,  serving  the  formal  purpose  of 
associating  an  infinite  sequence  jr^J  with  every  play  of  the 
game,  .whether  it  tenninates  or  not. 

If  one  of  the  players  is  eventually  ruined,  the  "utility" 
payoff  to  player  I  can  be  defined: 


(2) 


1 


if  r  <  0 
if  r  2  R, 
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where  r  •  11m  r.  If  both  players  survive  indefinitely,  the 

i\ 

payoff  will  be  a  number  Q,  which  may  be  a  function  of  the  course 
of  play.  When  we  are  not  considering  special  cases  we  shall 
let  Q  be  entirely  arbitrary,  assuming  only  0  ^  Q  <  1.  The  pay¬ 
off  to  player  II  is  taken  to  be  1  minus  the  payoff  to  player  I. 

Thus,  the  survival  game  is  completely  specified  by  the  five 
elements:  ||a^||,  Q#  and  rQ> 

Assume  for  the  moment  that  Q  is  a  constant,  and  that  the 
value  of  the  game  exists  for  every  initial  state  r^.  Then  it 
is  easily  proved  that  the  value  is  a  monotonic  increasing  function 
of  Tq,  and  that  it  satisfies  the  functional  equation: 

(3)  4>(r)  -  val  |  |<>(r+a1J )  j  | ,  0  <  r  <  R, 

with  boundary  conditions : 

(4)  4>(r)  «  p(r)  r  <;  0,  r  >  R. 

Here  "val"  denotes  the  ordinary  mlnimax  value  of  a  matrix  game . 

Even  if  3  is  not  constant,  equations  (3)  and  (4)  play  a 
very  fundamental  role  in  the  analysis.  As  we  shall  see  in  section 
2  of  this  paper,  there  always  exists  at  least  one  monotonlc  solu¬ 
tion  to  (3),  (4).  If  this  solution  is  unique,  then  the  value  of 
the  survival  games  exists  and  1e  independent  of  Q.  If  the  solu¬ 
tion  la  not  unique,  then  the  value  may  not  exist,  and  it  is  not 
independent  of  Q  if  it  does  exist. 

[To  Illustrate:  in  the  first  example  below,  all 
raonotonic  functions,  and  some  others,  are  solutions  of 
(3).  In  the  second  example,  any  linear  or  neai'-linear 
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functlon  is  a  solution.  In  both  cases  the  dependence 
of  the  game  on  Q  Is  Intuitively  obvious,  since  both 
players  have  powerful  "defensive"  strategies  that 
prevent  any  action  from  taking  place  except  on  favor¬ 
able  gro -nd .  In  the  third 


Example  1  Example  2  Example  3 

example  equation  (3)  becomes  trivial  and  Irrelevant.  The 
game  turns  entirely  on  the  properties  of  Q.  An  example 
of  Qale  and  Stewart  [8]  shows  that  the  value  does  not 
exist  for  certain  payoffs  of  the  form  Q  ■  Q( 1 ^ ,  J^,  1^,  ... 
Whether  such  indeterminacy  can  ever  occur  when  Q  has  the 
form  Q(r1#  ...  )  Is  an  open  question.] 

A  mixed  strategy  In  the  survival  game  can  be  represented 
as  a  probability  distribution  on  1  (or  j)  for  each  round,  as  a 
function  of  the  past;  this  Is  the  so-called  'behavior  strategy" 
form.  We  snail  call  a  mixed  strategy  locally  optimal  If  for 
every  k  the  probabilities  it  prescribes  for  1^  (or  J^)  ire 
optimal  in  tne  matrix  game  ||v(r^_^  +  ) ||  ,  v  being  the  value 

function  of  the  survival  game .  Locally  optimal  strategies  exist 
whenever  the  value  function  exists,  but  they  need  not  be  optimal, 
nor  are  optimal  strategies  necessarily  locally  optimal. 
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[ihus,  in  example  4,  consider  the  strategy  that  picks 
i^  -  2  if  and  only  if  >1.  It  ia  clearly  locally 

optimal,  since  the  value  function  la  identically  1,  but 
it  is  not  optimal  if  R  >  2  and  Q  <  1.  Again,  in  example 
5,  the  strategy  that  always  chooses  1^  ■  3  is  locally 
optimal  but  not  optimal  if  Q  <  1  and  >  1 .  (In  this 
example  the  value  depends  on  Q.)  In  example  o,  the  mixed 


/ 1 1 

( 1 

-1) 

( 1 

-i  l\ 

-1 

1 

-1 

1  1 

lo 

o) 

r1 

-l 

Example  4  Example  -  Example  b 

strategy  that  prescribes  the  probabilities  (l/3,  1/3,  1/3) 
for  1^  if  -  3  and  the  probabilities  (1/2,  1/2,  0)  if 

-  1  or  2,  or  if  k  -  1,  is  optimal  for  player  I,  but 
it  is  not  locally  optimal,  since  it  fails  to  take  full 
advantage  of  the  occasions  when  player  II  makes  the  "mistake" 
of  playing  j  -  3-] 

A  semimartingale  may  be  defined  as  a  sequence  of  random 
variables  |x^|  such  that  the  conditional  expectation  of  each 
term  is  greater  than  or  equal  to  the  preceding  term,  thus: 

E  |>  I  *k-r  •••-  xo}^  *k— i- 

A  fundamental  theorem  ([5]*  page  324)  implies  that  a  bounded 
semi-martingale  converges  with  probability  1 ,  and  that  its 


A 
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11m It  x^  satisfies 

E  {XC0  I  xo}  2*0  • 

For  our  purposes,  "bounded"  can  be  taken  to  mean  that  the  xk 

t 

themselves  are  bounded,  uniformly  in  k,  although  the  results 
stated  are  valid  under  much  weaker  condltiois. 

Let  $  be  any  bounded  solution  of  (}) .  We  define  a  local 
4>— strategy  to  be  a  mixed  strategy  that  always  prescribes  optimal 
probabilities  for  the  games  ll$(ri(_1  +  ai j )  I  I  •  in  this 

terminology,  a  locally  optimal  strategy  is  a  local  v-strategy. 

If  player  1  uses  a  local  <^— strategy  against  an  arbitrary  strategy 
of  player  II,  then  the  sequence  j<Kric)|  that  1b  generated  is  a 
bounded  semimartingale.  (Note  that  E^tr^)  |  rk_1#  •••#  rQ J  2  4* ( rk— 1 ) 
implies  B^(rk)  |  $(rk-1),  ...»  4>(rQ)}  >+(rk__1)#  even  though 
4>  may  not  be  one-one.)  Hence  we  have  convergence  with  probability 
1 ,  and 

E  {lim  4(rk)  |  rQ  J  ^  <Mr0) . 

Now  if  4  satisfies  (4)  as  well,  the  left  side  of  this  inequality 
can  be  expressed  as 

0*prob  1 1  is  rulneaj  +  1  *prob  j  II  is  ruined j  +  £»prob  {both  survlvej-, 

where  0  is  some  number  between  0  and  1.  Hence  1 

(5)  prob  |ll  Is  ruined^  ^  4(**q)  —  <*»prob  {both  survive  |  ; 

(o)  prob  {i  survives  j  ^  4(^q)  4-  (l-^)*prob  {both  survivej. 

Thus,  such  a  strategy  for  player  I  guarantees  that  he  will  survive 
with  probability  4(Tq).  If  we  could  show  that  double  survival 
has  probability  zero,  at  least  for  some  particular  local  4— 1 strategy 
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of  player  I,  than  It  would  follow  that  he  can  guarantee  himself 
an  expected  payoff  of  4(Tq),  or  more,  regardless  of  the  other’s 
atrategy,  and  regardless  of  Q.  A  similar  argument  for  player  II 
would  then  establish  the  existence  of  a  value  and  optimal  strategies 
for  the  survival  game.  Independent  of  Q. 

In  stteaptlng  to  carry  out  a  proof  oo  the  above  line#,  one 
might  hope  to  start  with  an  arbitrary  local  <$>-etrategy  and  (1) 
use  the  known  convergence  of  {4(r^)}  to  establish  convergence 
of  ^r^J ;  then  (ii)  use  the  convergence  of  jr^J  to  show  that  the 
game  must  end;  all  with  probability  1.  Unfortunately,  neither 
(1)  nor  (11)  is  unconditionally  valid.  In  section  3  we  proceed 
by  way  of  strictly  monotonlc  approximants ,  for  which  (i)  is 
valid,  and  obtain  thereby  the  existence  of  the  value.  In  section 
4  we  obtain  the  existence  of  optimal  strategies  by  working  with 
a  special  class  of  "interior  ^-strategies,"  which  make  Jr^J  con¬ 
verge  even  when  4  1®  not  strictly  monotonic.  However,  in  both 
proofs  it  Is  necessary  to  assume  that  none  of  the  1b  zero, 
in  order  to  make  convergence  of  jr^j  equivalent  to  termination 
of  play  (step  (11) ) . 

In  section  5  we  drop  the  zero— free  condition  on  jja^il, 
and  find  that  a  value  still  exists  if  Q  is  sufficiently  regular. 
However,  the  value  may  depend  or.  Q.  (see  samples  1,  2,  5  above), 
and  the  players  may  not  have  optimal  strategies  (example  7  below). 
Our  proof  parallels  the  one  in  section  3  (strictly  monotonic 
approximants),  but  is  based  on  a  more  complicated  functional 
equation,  to  be  dlsoussed  there. 
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Plnally,  In  section  6  we  will  derive  some  estimates  for  the 
value  function  that  h'jve  much  in  common  with  the  well-known  ap¬ 
proximate  solutions  of  the  classic  "gambler's  ruin"  problem. 

They  have  simple  analytic  forms,  in  contrast  to  the  sharply 
discontinuous  nature  of  the  exact  value  functions  (see  examples 
8  and  9  below).  The  estimates  become  more  precise  if  R  is  made 
large  compared  to  the  a^ , ,  and  they  give  exact  information  if 
the  are  all  ±  1,  or  ±  1  and  0.  They  also  provide  strategies 
that  are  approximately  optimal . 

It  should  be  noted  that  seotlons  3,  5#  and  6  are  essen¬ 

tially  Independent  of  one  another. 


[in  example  7,  player  I  can  win  with  probability 
approaching  1  if  he  always  chooses  i^  according  to  the 
distribution  (l-£,  £-€  ,  t  ),  with  £  small  but  positive. 
However,  if  Q  <  1  he  has  no  strictly  optimal  strategy. 
Example  8  illustrates  in  a  simple  way  some  of  the  pos¬ 
sibilities  for  the  value  function  v(r).  Under  optimal 
play  the  first  player's  fortune  describes  a  random  walk 


0 


U  1) 


2+£||  — 2— 

— 2-f«  i  2+£*a 


r1  w 

Example  [  Example  8  Example  9 

on  (0,  R)  with  4-1  and  —a  having  equal  probability.  The 
value  is  Juat  the  probability  of  absorption  at  R.  If 
a  is  rational  then  the  value  is  a  finite  step— function, 
which  can  be  determined  exactly  by  solving  a  certain 
system  of  linear  equations.  But  if  a  is  irrational 
(with  R  >  1-fa  >1),  then  the  value  function  is 
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dlscontlnuous  on  &  set  of  points  everywhere  dense  In  (0,  R); 
It  is  strictly  monotonic;  and  Its  derivative  is  almost  every¬ 
where  0.  In  example  9  the  are  meant  to  be  small  pos¬ 
itive  lncomenaurablea .  We  no  longer  have  a  simple  random 
walk  as  above,  but  It  can  be  shown  that  for  R  ■  3  the  value 
is  constant  in  an  interval  slightly  larger  than  (1,  2)  and 
has  discontinuities  everywhere  dense  in  the  rest  of  (0,  R). 
Whether  the  derivative  vanishes  almost  everywhere  in  this 
case  is  an  open  question.] 


2 .  SOLUTIONS  OP  THE  FUNCTIONAL  EQUATIONS 


A  monotonlc  solution  to  (3),  (4)  can  be  constructed  by  an 
iterative  procedure.  Define  4q  by  * 


0 


if  r  <  R 


*0(r) 


if  r  2  R 


and  let 

(7) 


T^q,  where  the  transformation  T  is  given  by: 

r 


T+(r) 


val  |  ^(r+a^  )  |  | 

<Mr) 


0  <  r  <  R 
r  £  0,  r  >  R. 


It  is  clear  that  can  be  interpreted  as  the  value  function  of 
the  finite,  truncated  game  in  which  player  I  loses  unless  he 
succeeds  In  ruining  his  opponent  in  n  moves  or  less. 


LEMMA  1.  The  sequence  |4n|  Just  defined  converges 
pointwise  to  a  monotonlc  solution  of  (3),  (4). 
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Proof .  By  construction,  the  fixed  points  of  (7)  are  sol¬ 
utions  of  (3),  and  conversely.  Since  T  is  continuous,  it  suffices 
to  show  that  lim  <^n  exists  and  is  nonotonic.  This  is  accomplished 
by  showing  inductively  that  4>n(r)  la  monotonic  increasing  in 
both  n  and  r.  The  details  present  no  difficulty  whatever, 

(Compare  the  much  harder  proof  of  lemmas  6  below.) 

Let  denote  the  limit  of  the  <±  ,  and  let  v.  denote  the 
0  Tn'  1 

limit  of  the  similar  (descending)  sequence  jT^oj*  beginning 
with  the  function 


If  r  <  0 
if  r  >  0. 


THEOREM  1  .  If  Q  9  0  then  the  value  of  the  survival 
game  exists  and  is  equal  to  vq(i'q)«  If  Q  a  1  then  the 
value  exists  and  is  equal  to  v^(Tq). 


Proof .  Player  I  can  guarantee  that 
proc  jll  is  ruined j  2 

by  following  an  optimal  strategy  for  the  nth  truncated  game  (and 
playing  arbitrarily  after  the  n^  move).  On  the  other  hand, 
player  II  can  guarantee  tnat 


preb  survives}  2  1  ~ 


W 


b>  adopting  a  local  Vq— strategy  (see  (6)  above).  But  the  payoff 
of  the  Q  ■  0  game  depends  solely  un  whether  player  II  survives 
or  not.  Therefore  vq ( ro )  vaIUtf  •  ether  case  is  similar. 
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Note  that  the  proof  provides  an  optimal  strategy  for  player 
II ,  but  not  player  I ,  If  0  -  0.  The  existence  of  this  optimal 
strategy,  and  of  the  value,  could  have  been  deduced  from  the 
lower  semi-continuity  of  the  payoff,  as  a  function  of  the  pure 
strategies  (see  [9] )  •  A  similar  remark  applies  to  the  Q  -  1 
game . 

THEOREM  2.  If  (5),  (4)  have  a  unique  solution 
then  the  value  of  the  survival  games  exists  and  is  equal 
to  4(rQ),  independently  of  0. 

Proof .  As  before,  player  I  can  ensure  that 
prob  {il  is  ruined}  2  <i>n(r0)  • 

Similarly  player  II  can  ensure  that 

prob  [i  is  ruined]  2  1  —  ^(Fq)  * 

Bit  11m  4n  -  vQ  -  4>  -  v:  -  lim  4^;  hence  $(rQ)  is  the  value  of 
the  game . 

Note  that  this  time  we  do  rot  obtain  an  optimal  strategy 
for  either  player. 

The  next  lemma  identifies  Vq  and  v^  as  the  ’’extreme"  sol¬ 
utions  of  (5)#  ( 4 ) ;  and  incidentally  establishes  a  converse  to 
theorem  2. 

LEMMA  2.  If  4  is  any  solution  of  (}),  (4)  that  is 
bounded  between  0  and  1,  then  <  v^ . 

Proof .  We  observe  that  <  4>,  and  that  4>n  <  $  implies 
T+  <  4*  Hence  v^  <  $  .  Symmetrically,  2 


I 
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COROLLARY.  If  the  value  function  of  the  survival 
game  exists  and  is  Independent  of  4,  then  it  is  the  only 
solution  of  (3),  (4)  bounded  between  0  and  1. 


The  last  provision  is  necessary,  since  "spurious"  unbounded 
solutions  do  sometimes  occur. 

The  next  lemma  shows  that  v^  and  v^  usually  have  Jumps  at 
0  and  R,  and  cnaracterizes  the  exceptions  in  terms  of  the  matrix 


LBMMA  3*  (A)  The  following  are  equivalent  1 

(1)  v^(r)  is  continuous  at  r  -  R; 

(ii)  v^r)  m  l  for  0  <  r  <  R; 

(ill)  I  I a jL J  I  I  ha8  a  honnegative  row. 

(B)  The  following  are  equivalent: 

(1)  Vq(t)  la  continuous  at  r  ■  R; 

(11)  vQ(r)  e  1  for  0  <  r  <  R; 

(ill)  every  set  of  columns  of  considered 

as  a  submatrix  of  |  |  a^  |  |  ,  has  a  nonnegative  row,  not 
all  zero. 

Corresponding  statements  hold  concerning  continuity  of 


Vq  and  v^  at  r  -  0. 


Proof.  (A)  Obviously  (ill)  ->  (il)  ->  (i).  If  (ill)  is 

false  there  is  a  negative  entry  in  each  row.  A  strategy  of 

playing  all  columns  with  equal  probability,  on  every  move,  gives 

[-R/a] 


player  II  a  probability  2  n 


of  winning,  if  n  is  the  number 


of  columns  and  a  is  the  smallest  nonzero  a 


U 


This  gives  a 


P— 622 
10-10-56 
-13- 


poaitive  lower  bound  for  1  -  v^(r q)  ,  independent  of  r q,  and 
makes  v1  discontinuous  at  R.  Hence  (1)  ->  (ill). 

(B)  Obviously  (ii)  ->  (1).  If  (ill)  la  false  there  is  a 

set  of  s  columns  on  which  player  II  can  distribute  his  cholceB 

I-R/a] 

with  equal  probabilities  1/s,  giving  him  a  probability  ^  8 
of  surviving.  Hence  Vq(Tq)  Is  bounded  away  from  1  and  v^  Is 
discontinuous  at  R.  Banos  (i)  ->  (iii).  To  complete  the  proof, 
suppose  that  (Hi)  holds  but  not  (il).  Choose  r*  >  0  so  that 
v0(r*)  <  Vg(r*+a).  Then  Vq(t*)  is  strictly  leas  than  vo(r*+aij) 
whenever  a^  is  positive .  Let  ^  be  an  optimal  mixed  strategy 
for  II  In  the  matrix  game  | | , )  |  | ;  let  3  be  the  set  of 
columns  J  with  ^  >  0;  and  let  ig  be  the  nonnegative  subrow, 
not  all  zero,  whose  existence  is  asserted  by  (ill).  Then 
v0(r*)  ^  Vgfr^+a^  holds  for  J  in  S,  with  strict  inequality 
at  least  once,  and 


nj  vo(r,)  ^  'Ij  v0(r#+alsj) 

holds  for  all  J,  with  strict  inequality  at  least  once.  Summing 
over  J,  and  recalling  the  optimality  ol  fj,  we  obtain: 


v0<r#)  <  L  Vo*r#+ai  J ^  -  val  Nvo^r#‘*'aij^  I  * 

J  s 

But  Vq  is  a  solution  of  (3),  making  the  first  and  last  terms 
equal.  This  contradiction  establishes  (iii)  •>  (11). 

CORROLARY .  If 

max  min  a.  ,  <  0  <  min  max  a.  . 

1  j  J  i 
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then  every  bounded  solution  of  (3),  (4)  has  jumps  at 
0  and  R. 

It  may  be  of  Interest  to  describe  some  near-optimal  strategies 
for  player  I  In  the  event  that  (1),  (11),  (ill)  of  (B)  hold. 

(Compare  example  7  above.)  Let  Sq  be  the  set  of  all  columns; 
let  1q  be  a  row  nonnegative  and  not  Identically  zero  on  S^; 
let  S.  be  the  subset  of  Sn  on  which  a.  -  0;  and  bo  on.  Then 

1  U  IqJ 

we  have  SQ  D  -  $,  for  soma  p  (proper  Inclusion 

all  the  way),  and  moreover  the  1q,  ...,  lp  are  all  distinct. 

Then  It  is  easy  to  show  that  the  probabilities  : 

^  *  i  -  t ,  f £e,  . ..,  f  -  tp,  J.  -  t 

1o  11  Xp-1  Xp 

all  other  ^  «  0,  if  used  repeatedly  by  player  I,  guarantee  with 
probability  >  1  -t  that  the  first  nonzero  a, ,  to  occur  will  be 
positive.  Hence  player  I  wins  with  probability  j>  (1-0  ^  1 ro^/al  , 

no  matter  what  player  II  does.  Tnis  bound  goes  tc  1  as  €->Q. 

EXISTENCE  OP  A  VALUS  WHEN  ||a1  ||  IS  ZERO— FREE 

This  section  will  be  devoted  to  the  proof  of  the  following 
theorem  : 


THEOREM  If  ||a.  ||  is  zero— free,  tnen  the 
value  of  the  survival  game  exists  and  is  independent 
of  the  payoff  Q  assigned  to  nonterminat ing  play. 

During  the  proof  we  snail  worw  with  certain  generalized 
survival  games,  n^vlng  more  general,  bounded  payolf  functions 
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P*(r).  In  place  of  the  P(r)  of  (2).  The  other  elements  of  the 
game,  namely  ll*jjll»  Q#  R  and  Tq,  remain  as  before.  The  functional 
equation  (3)  Is  still  applicable,  but  with  new  boundary  conditions: 

(4#)  4(r)  -  P#(r)  r  <  0,  r  >  R. 


LSMMA  4.  Suppose  that  (3)#  (4*)  have  a  strictly 
monotonic  solution  Then,  if  Ija^jM  Is  zero— free, 

the  value  of  the  generalized  survival  game  exlata  and  la 
equal  to  . 


Proof .  Let  player  I  use  a  local  strategy  piayer  jl 
an  arbitrary  strategy.  Then  is  a  bounded  semimartingale, 

and  converges  with  probability  1.  Because  4*  !»  strictly  monotonic, 


|rjJ  also  converges, 
none  of  the  a^  -  0, 


This  means  that  play  terminates,  since,  with 
the  limit  of  jr^j  must  be  outside  (0,  R) .  Hence 


k{p«(U®  rK)}  -  b{+'(11j»  rk)]  ^  4*(rQ). 


A  similar  argument  for  player  II  completes  the  proof. 

irfe  shall  consider  functions  P*  of  the  following  form  only 
(until  section  o) : 


£  (r— R— A) 

1  ♦  f(r-R-A) 


If  r  <;  0 
if  r  2  R, 


where  A  ■  maxja^jl,  and  t  Is  a  positive  constant.  As  t ->  0  these 
functions  approach  P(r)  from  below.  Imitating  the  construction  of 


Section  2,  we  define  4*  ■  where  T  Is  the  same  transformation 

(7),  and  1»  glv.n  toy i 


1  ♦  t(r-R— A) 


If  r  ^  R 

if  r  2  R- 


If  It  exists,  11m  i*  obviously  a  solution  of  (3),  (4#). 
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LEMMA  5.  If  vallJa^jlj  2  anci  vq  ia  not  con¬ 
tinuous  at  R,  then  for  sufficiently  small  £  the  sequence 
{**}  t  defined  converges  pointwlse  to  a  strictly  mono- 
tonic  solution  of  (3),  (4*). 

Proof .  To  show  that  the  limit  exists  we  observe  first 

tnat 

4>* ( r )  -  val|  l^fr+a^)  |  |  2  val  |  |t  (r-R-A+a^  )  |  | 

*  t  ( r— R— A )  +  f'valjla^jll  2  C(^-R-A) 

-  *3<r> 

if  0  <  r  <  R,  and  r)  otherwise.  Moreover,  2  ^#n— 1 

i 

Implies  2  ^n-i  "  ^n‘  ®inc*  ths  sequence  is  obviously 

bounded,  it  therefore  converges.  To  show  that  the  limit  is 
strictly  monotonlc  we  shall  prove  inductively  that  for  t  suf¬ 
ficiently  small  the  function  i*(r)  —  £r  is  monotonic  in  r  for 
each  n.  This  1b  trivial  for  4>qJ  assume  it  for  .  Case  1  : 

Take  0  <  r  <  s  <  R.  T^ien  we  have: 

4>*(r)  —  £  r  -  val  I  !  (r+a^  )-£r  |  | 

<>  val  I  I 

-  $*(a)  -  £ s  . 

Case  2  :  Take  r  0  <  s  <  R.  Then  ws  have: 

$*(r)  -  t  r  -  -  *r 

<  -  Cs 

$•(»)  -  £s 

(using  the  first  part  of  this  proof  in  the  last  step). 
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Case  3:  Take  0  <  r  <  R  ^  b.  Note  that  $>J  Vq  oveT'  the  entire 
range  of  interest  (—A,  R+A),  and  hence,  by  induction,  that 
£  v^.  Since  the  latter  is  assumed  discontinuous  at  R,  we 
can  select  t  so  that  £A  1  —  v^(R-)  .  Then  we  have: 

+»(r)  -  tr  ^  *»(R-)  -  £R 
^  v0(R-)  -  ER 
£  1  -  EA  -  £R 
-  ♦£(»)  -  £» 

(using  case  1  in  the  first  step).  The  other  cases,  namely 
r  <  e  ^  0,  r  ^  0  <  R  ^  s,  and  R  <  r  <  s,  are  trivial.  This 
completes  the  proof  of  lemma  b • 

Proof  of  theorem  J> .  There  is  no  loss  of  generality  In 

assuming  that  val|  |a^jl  I  2  0*  Th®  theorem  is  trivial  if  vQ  i  1 

in  (0,  R);  we  may  therefore  assume  (lemma  3)  that  vQ  Is  dis¬ 
contiguous  at  R.  Lemmas  4  and  5  now  give  us  well-defined  value 

functions  for  our  class  of  generalized  games,  for  i  suf¬ 
ficiently  small.  As  £ ->  0  their  payoffs  P#  converge  uniformly 

to  P#  our  original  payoff  function.  It  follows  that  lim  $*(rn) 

£-*0  U 

exists  and  is  the  value  of  the  original  game.  This  number  is 
obviously  independent  of  Q.  This  completes  the  proof. 

As  yet  we  know  nothing  about  the  existence  of  optimal 
strategies,  unless  Q  i  0  or  Qi  1.  As  example  4  showed,  local 
v— strategies  need  not  be  optimal.  However,  the  local  <|>*— strategies , 
for  given  £,  are  nearly  optimal:  it  can  be  shown  that  they 
guarantee  an  expected  payoff  within  £(R+2A)  of  the  true  value. 


P-622 

10-10-56 

-48- 


COROLLARY.  If  lla^jll  1b  zero-free  then  (3), 
(4)  have  a  unique  aolutlon  bounded  between  0  and  1 


Proof .  Theorem  3  and  the  corollary  to  lemma  2. 


4  .  EXISTENCE  OP  OPTIMAL  STRATEGIES 


In  thle  Bectlon  we  shall  find  optimal  strategies  for  both 


players,  under  the  assumption  that  Maijll  l®  zero— free .  The 
strategies  are  locally  optimal,  with  the  added  property  that 
they  force  play  to  terminate  with  probability  one.  Their 
optimality  is  therefore  independent  of  Q. 

Let  us  first  review  some  properties  of  matrix  games.  A 
pure  strategy  is  said  to  be  admissible  if  it  appears  with  pos¬ 
itive  probability  in  at  least  one  optimal  strategy.  We  call 
an  optimal  strategy  interior  if  it  lies  in  the  relative  interior 

i 

of  the  convex  Bet  of  all  optimal  mixed  strategies.  Every  matrix 
game  has  at  least  one  interior  optimal  strategy  for  each  player. 
For  later  reference  we  state  two  elementary  facts : 


(A)  If  val|  |b1J  |  |  -  val|  |ciJ  |  | ,  with  b^  £  c^, 


all  1,  J,  and  if  i*  and  J*  are  admissible  in  b 


Ic^M  respectively,  then 

(B)  An  interior  optimal  strategy  Mpuni3hes" 


every  inadmissible  strategy  of  the  other  player; 
that  is,  if  $  is  interior  optimal  and  J*  is  in¬ 
admissible  in  {|b^j||,  then 


£  V>ij.  > val i  itou 
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Returning  to  the  eurvival  game,  we  define  a  special  class 
of  strategies  for  player  1.  Let  $  be  a  monotonic  solution  of 
(3),  (4).  For  each  number  c  for  which  the  set  C  -  4>”*1(c)  18 
not  empty,  let  £(c)  be  an  interior  optimal  strategy  for  player 
I  in  the  matrix  game 

(8)  |  |  Inf  <K»+a11)|  |  . 

see  J 

Define  a  mixed  strategy  for  the  survival  game  by  the  rule : 

choose  1^  according  to  the  probability  distribution  ^ ( r^ _ ^ ) ) . 

Such  a  strategy  will  be  called  an  interior  j— strategy  of  player 
I.  Mote  that  the  same  probabilities  must  bo  used  each  time  the 
same  value  of  <^(r)  comes  up.  Interior  (^—strategies  of  player  II 
are  defined  similarly,  with  "supH  instead  of  "inf."  We  shall 
see  presently  that  an  Interior  ^—strategy  is  also  a  local 
^—strategy.  First  we  state  our  main  result. 

THEOREM  4.  If  $  is  any  monotonic  solution  of 
(3)»  (4),  and  if  I  1 aij I  I  zero-free,  then  the  in¬ 
terior  strategies  are  optimal,  independently  of  Q, 
and  the  value  of  the  game  is  ^(rQ). 

As  stated,  theorem  4  is  independent  of  and  includes  theorem 
3,  and  this  independence  will  be  maintained  throughout  the  proof; 
which  takes  up  the  rest  of  this  section.  Consequently  we  have 
a  separate  proof  of  the  existence  of  a  value  in  the  zero— free 
case.  Of  course,  4  1®  actually  unique  and  equal  to  v,  and  our 
real  object  is  only  to  show  that  the  interior  v-etrategies  are 
optimal . 
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LEMMA  6.  An  interior  ^-strategy  Is  also  a 
local  4> — strategy . 

Proof .  We  must  show  that  £($(r))  is  optimal  in  | | ^(r+a^j )  |  |  , 
for  all  r  in  (0,  R) .  But  ||$(r+a^j)||  majorizes  (8),  and  both 
matrices  have  the  same  value  ^(r),  by  (2)  and  the  fact  that 
was  assumed  monotonic.  Since  £($(r))  ia  optimal  for  (8)  by 
definition,  it  is  also  optimal  for  | | $(r+a^ ) | | . 

LEMMA  7.  Let  <${r)  >  0  and  let  r*,  i*,  J*  be  such 

that 

(1)  r*  -  r  +  a1#j#  <  r, 

(11)  J*  is  admissible  in  | | $ (r+a^ j ) | |  , 

(ill)  f1#(4»(r))  >  0. 

Then  4(r*)  f  fy(r) . 

Proof .  Suppose  to  the  contrary  that  <^(r*)  •  <J>(r).  Then 
1*  is  admissible  in  |  | $ (r*+a^ ^ ) j j  and  the  conditions  of  propos¬ 
ition  (A)  above  are  met,  with  regard  to  that  matrix  and 
|  lifr+a^  )  |  |  .  Hence  $ (r*+a1  #  )  -  ^(r+a1#J#) ,  or  $(r+2ai#J#)  -  4>(r) . 
Repeating  this  argument  gives  us  ^(r')  «*  $(r)  for  a  sequence  of 
r'  that  eventually  becomes  negative  (since  ai#j#  1®  negative), 
contradicting  the  hypothesis  that  $(r)  >  0. 

LEMMA  8.  If  player  I  uses  an  interior  (^-strategy 
against  any  strategy  of  player  II,  then  every  possible 
play  of  the  survival  game  has  the  property  that,  for 
each  k  >  0,  one  of  the  following  is  true: 
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(a)  rk_i  1°  or  rk_1  >  R; 

(b)  -  0; 

(c)  J,  la  inadmissible  in  1  |4>(r  , +a  )  |  |  ; 

K  K— i  1J 

(d)  rk  2  rk_1+  a»  where  a  -  min  la^j; 

(e)  4(rk)  |  $(r^_, ) . 

Pruof.  By  lemma  7,  since  if  (a),  (b),  (c),  and  (d)  are 
false  the  hypotheses  of  that  lemma  are  met,  and  (e)  follows. 

The  importance  of  this  lemma  lies  in  the  fact  that  it 
sharply  restricts  the  possibility  of  a  non terminating  play  in 
which  {<Mrk)}  converges. 

We  need  two  more  preparatory  result^  before  proceeding 
to  the  proof  of  the  mail  theorem.  Qiven  an  Interior  1 strategy 

of  player  1,  define  the  "punishment"  function. 

»(r,  J)  -  £  4(c^r*ai  < )  “  c' 

1 

where  c  -  $(r)-  (Compare  proposition  (B)  above.)  By  lemma 

b,  w  la  always  nonnegative. 

LEMMA  y.  If  J  is  inadmissible  in  ||$(r+a^j)|| 
then  i (r,  J )  >  0 . 

Proof .  By  proposition  B  and  the  definition  of  interior 
$>— strategy  we  have 

L  (c)  inf  ( s+a.  ,)  s  c, 

^  s'  C 

where  C  •  ^^(c),  c  ■  ♦(**).  The  required  inequality  is  now 
obtained  by  removing  the  "inf"  and  substituting  r  for  s. 
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UWMA  10.  If  player  I  uses  an  Interior  ^—strategy 
against  any  strategy  of  player  II,  then  with  probability 

rK-l 

Proof .  (Compare  [5],  page  297,  theorem  1.2  (i).*)  Consider 

the  sum  of  the  v  .  For  each  n  >  1  we  have: 

k  — 

E{|  ”k)  -  E{£  tE{*(rP  1  rx-i}  -  ^rK-i>i| 

-  i  [E(*(rk)}  -  K{*(rk_,)|] 

* 

-  E{+(rn)}  -  e{^ ( r0)} 

£  1- 


one  tne  eo^uen* e 


K}  ■  {'( 


>} 


converges  to  0 


It  follows  that  the  probability  of  the  infinite  sum  exceeding 
any  given  bound  M  is  <  l/M.  Hence,  with  probability  one  the 
3 e i ie 3  has  a  f  inite  sun  and  converges  to  0. 

Proof  of  theorem  4  .  The  theorem  la  easy  if  there  is  a  pos¬ 
itive  row  or  negative  column  in  |  |  a.  ,  |  |  .  We  therefore  assume 

1  O 

max  min  a,  ,  <  0  <  min  max  a.  , . 


Let  piaycr  I  adopt  an  interior  ^—strategy,  and  player  II  an 
arbitrary  strategy.  Tne  play  of  the  game  that  the  occurs  can 
be  described  by  the  pair  of  sequences  |l^| ,  jj^j ,  which  we  shall 
regard  as  the  underlying  random  variable.  Tney  are  sufficient 
to  determine  three  other  important  sequences  jr^j  ,  and 

l^(rk)j*  laB t-na:ae^  i*  a  bounded  semimartingale,  by  lemma 

o,  and  therefore  the  set  of  plays  ji^j  ,  for  which  it  fails 

to  converge  has  probability  zero.  The  set  of  plays  for  which 
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fails  to  converge  to  0  also  has  probability  zero,  by 
lemma  10.  We  shall  prove  that  every  play  outside  these  two 
sets  terminates.  By  (5)  this  will  imply  that  player  I's  in¬ 
terior  ^—strategy  assures  him  an  expected  payoff  2  <HrQ)*  I'1® 
corresponding  argument  for  the  other  player  will  complete  the 


proof . 


Consider  therefore  a  play  {h}*  {4} in  "hl  ch  both 


and 


(i°)  {v}  ->0. 

If  c  -  0  and  1  then  play  must  terminate,  because  of  the  fact 
that  ^  1®  discontinuous  at  0  and  R  (see  the  corollary  of  lemma 
3,  section  2) .  Thus  our  object  will  be  to  show  that  the  hy¬ 
pothesis  0  <  c  <  1  leads  to  a  contradiction.  Let  jknj  be  the 
sequence  of  indices  k  such  that  $(r^)  f  c  °r  ^  f  0,  or  both, 
and  let  sp  •  r^  •  Lemma  d  shows  that  jknJ  and  js^j  have  in¬ 
finitely  many  terms,  since  alternatives  "(a)"  and  "(b)"  are 
excluded  by  hypothesis,  while  any  unduly  long  chain  of  "(d)" 
will  take  rk  out  of  the  interval  C  »  ^*~1(c).  Thus,  instances 
of  "(c)"  or  "(e)"  must  occur  regularly,  giving  us  r  f  0,  by 
lemma  9,  or  4(ri<)  +  ^(r^^).  **act#  consecutive  terms  of 
jknj  cannot  differ  by  more  than  [(*"/a)  +  2],  where  /  iS  the 
length  of  C,  a  •  m^nlc^l,  and  [x]  is  the  greatest  integer  <;  x. 

Let  us  now  examine  the  possible  limit  points  of  the  sequence 
Js\  ,  bearing  in  raind  properties  (9)  and  (10).  First  we  have 
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the  upper  and  lower  endpoints  of  C;  call  them  u  and  *  respec¬ 
tively.  (If  C  Is  empty,  a  short  argument  shows  that  (9)  is 
contradicted.)  Secondly,  there  are  the  points  within  C,  in 
the  neighborhood  of  wnlch  can  be  arbitrarily  small,  but 
positive.  There  are  only  a  finite  number  of  such  points,  since 
for  each  J,  v(r,  J )  is  a  raonotonlc  increasing  function  of  r  in 
C;  denote  these  points  by  y^ ,  y^ ,  ...»  y  .  Let  6  be  a  small 
positive  constant  (it  has  an  exact  value,  which  will  be  defined 
later),  and  let  Y^,  Y^#  . ..,  Y^  be  a  collection  of  Intervals, 
variously  open  and  closed,  but  all  of  length  6,  deflneu  as 
follows : 

« 

if  u  i  c 

if  U  £  C 

if  /  4  c 
if  /  6  c 

5  <  1  <  p. 


Y,  - 


[u,  u+6) 
(u,  u+b) 

(*-5,  *\ 


Yl  "  (yl'  yi+6l 


Let  Y  denote  their  set— theoretic  union.  By  (9),  (  10)  there  is 
an  n^  (depending  on  5)  such  that  sn  6  Y  for  all  n  >  n^ . 

Now  define  S  to  be  the  smallest  nonzero  number  of  the  form: 


(ID 


x 

1 


N  <  p[(ar/a)+2]  . 


The  effect  of  this  definition  is  to  ensure  that  when  { m — n ]  £  p, 
the  difference  Is  -o  I  is  either  0  or  >  6.  It  follows  that, 
teL  n  >  nQ,  all  8n  lying  in  a  given  Y^  are  equal  (iroof  below). 
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Hen  oe  some  8*  appears  Infinitely  often  in  the  sequence  |snj  . 

If  s*  ^  C  then  (9)  is  contradicted.  If  3*  €  C  then  (10)  is 

contradicted,  since  v,  is  Infinitely  often  positive,  and 

Kn 

bounded  away  from  0  by  the  smallest  nonzero  *(s#,  J  )  .  This  is 
the  desired  contradiction. 

Plnally,  we  have  to  prove  the  statement  above  in  Italics. 

Call  a  pair  (®m»  ®n)  conflicting  if  they  lie  in  the  same 

but  are  unequal.  Either  the  statement  in  question  is  true  or 

there  is  a  conflicting  pair  (s  ,  s  ),  coming  after  s  ,  and 

m  n 

spanning  no  other  conflicting  pair  (s^, ,  s^ ,  ) ,  ra  <  m 1  <  n'  <  n. 
Let  h)q  »  ra  and  let  m  .  +  ^  be  the  last  Integer  <  n  such  that  sm 


J 

and  sm  lie  in  a  common  interval  .  Then  the  ascending 
sequence 


.HI 


dIq  ,  m1  ,  m 


^ »  «‘2 »  •  •  •  #  ^  •  n 


has  at  most  p+1  terms,  and  has  the  property  that  s^  ■  s„ 

'  m .  .  m ,  +  l 

j  +  j 

is  the  sum  of  s  and  at 

m‘  raJ-l 

e  | s  — s  I  is  of  the  form 
m  n 


for  each  J .  We  see  that  each  a 


most  [(y/a)+2]  increments  a.  .  .  Henc 

\  Jy 

(11),  and  is  either  0  or  6.  This  contradicts  the  assumption 


that  (s  ,  s  )  was  a  conflicting  pair. 
'  m  n 


3.  EXISTENCE  QP  A  VALUE  IN  QKNgRAL 

When  there  are  zeros  in  the  llajj!l  matrix  a  unique  solution 
to  the  fundamental  equations  (3),  (4)  is  no  longer  assured,  and 
the  value  of  the  survival  game  may  depend  on  the  double-survival 
payoff  Q.  In  this  section  we  show  that  the  value  does  exist 
if  Q  is  sufficiently  regular.  Our  proof  makes  use  of  a  new 
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pair  of  functional  equations  involving  the  notion  of  recursive 
game  (equations  (}),  (^'  oelow),  which  reduce  to  (3),  (h)  If 
|  |  a.  |  |  is  zer^-free,  ana  which  always  have  a  unique  solution. 

*J 

The  restriction  on  Q  consists  in  assuming  that  whenever 
|rK|  converges  to  a  limit  r  within  (0,  R),  the  peyoff  depends 
only  on  tnat  limit:  Q  -  F(r).  We  assume  F  to  be  tnonotonlc 
increasing  an.!,  of  course,  bounced  between  0  and  1.  It  is 
convenient  to  amalgamate  it  with  ♦'he  old  function  P,  which  was 
defined  only  outside  (0,  R),  Lind  denote  both  by  F.  The  still— 
arbitrary  portion  of  Q  will  be  denoted  by  "5.  Thus,  the  principal 
distinction  in  the  present  set-up  is  between  convergent  play 
(payoff  F)  and  noncon vergent  {  lay  (payoff  ^)  ,  replacing  the  for¬ 
mer  uiatlnction  between  terminating  play  (payoff  P)  ana  non- 
terminating  play  (payoff  Q) . 

Note  that  tne  present  arrangement  still  Includes  the  impor¬ 
tant  special  cases  Q  e  constant.  On  the  other  hanu,  the  mis¬ 
chievous  Qule-Stewart  functions  (example  )  in  section  l)  are 
kept  out  . 


THEOREM  0.  If  the  convergent— p lay  payoff  is 
a  raonotonic  function  F  of  the  limit  of  the  first  player's 
fortune,  then  the  value  of  tne  survival  game  exists  and 
is  independent  of  the  payoff  ^  for  nonconvergrnt  play. 

The  proof  follows  the  same  general  lines  as  tne  proof  of 
theorem  $  in  section  j .  However  we  must  begin  with  some  new 
definitions  and  notation. 
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By  an  elementary  recursive  game  [m,  pj  we  shall  mean  the 

following:  A  matrix  1 1 mi j I i  *  M  ia  given,  each  entry  being 

either  a  number  or  the  symbol  (R)  .  Players  I  and  II  choose 

1.  and  J  respectively.  If  m,  .  Is  a  number  the  game  ends, 

1  1  i1j1 

.and  II  pays  I  the  Indicated  amount.  If  m.  .  is  R^  there 

1J1 

Is  no  payment,  and  the  players  go  back  to  the  beginning  and 
make  new  choices  1^  and  etc.  In  case  of  infinite  repeti¬ 
tion  the  payoff  Is  the  number  p  (a  constant). 

The  above  Is  a  special  case  of  the  recursive  games  defined 
by  Bverett  [t>]  ,  except  for  the  "p"  feature.  (Everett  effectively 
assumes  that  p  -  0.  However,  [m,  pj  is  obviously  equivalent 
to  (m' ,  oj ,  with  M'  obtained  by  subtracting  p  from  each  numer¬ 
ical  entry  of  M.)  Translating  the  results  of  [t>]  we  find  that 
the  elementary  recursive  game  has  a  value,  which  we  shall  denote 
by  vaT  (m,  p} ,  though  perhaps  not  optimal  strategies .  The  value 
satisfies  the  relation 


(12) 


x 


val 


# 


where  llm^sxj1  is  the  matrix  obtained  by  inserting  the  numerical 
variable  x  in  place  of  in  I  I mij  I  I  •  ®olutlons  of  (12) 

fona  a  closed  Interval,  and  it  develops  that  val  (m,  p]  is  the 
solution  of  (12)  that  is  closest  to  p. 

The  new  functional  equations  can  now  be  formulated;  they 

are  : 

(3)  4(r)  -  val  (m(4,  r),  F(r)j,  0  <  r  <  R 

and 
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♦(r)  -  F(r), 


r  ^  0,  r^R, 


where  M(<^,  r)  is  the  matrix  with  entries: 


.  J<J»(r+a  ) 

(T)  and  (4)  are  actually  the  same.  If  |  |  a, 


^  #1J  +  0 

if  8lJ  -  0 


is  zero-free. 


then  (3)  reduces  to  (3)*  In  general,  if  $  is  a  solution  of  (3), 
then  ( 12)  gives  us  j 

4(r)  -  val  |  |  m1  j  (^ ,  r):  ♦(  r)  |  |  -  val  |  ^(r+a^  )  |  |  ; 

that  is,  ^  is  a  solution  of  (3)  as  well.  The  converse  is  not 
true,  however,  since  in  fact  (3)#  (^)  always  have  a  unique  sol¬ 
ution,  while  (3),  (4)  do  not. 

As  In  section  2  ( lemma  l),  we  can  construct  a  monotonic 
solution  Vq  to  (3),  (*T)  by  Iterating  the  transformation  T: 


*t(r)  - 


val(M(4,  r),  F(r)J 


4(r) 


0  <  r  <  R 
r  <,  0,  r  2  R» 


applied  to  the  same  initial  function  ^(r)  which  la  0  for  r  <  R 
and  1  for  r  2  R*  It  is  easily  shown  that  the  functions  *Vr) 
are  monotonlc  in  r  and  form  a  bounded  increasing  sequence;  the 
limit  is  the  desired  function  Vq .  (It  can  be  interpreted  as 
the  value  function  of  the  *  0  gome  (compare  theorem  1),  but 
there  is  no  point  In  establishing  this  fact  now,  in  view  of  the 
stronger  result  that  will  be  proveu  as  theorem  7.) 

As  before,  we  Introduce  certain  generalized  payoff  functions 
F*^r);  they  will  be  assumed  monotonlc  Increasing  in  (—A,  R+A). 

ITie  symbols  (3*)#  (^T*),  (7#)  will  refer  to  equations  (3) ,  (^) , 

(7)  with  F  replaced  by  F* .  The  next  lemma  corresponds  to  lemma  4 


in  section 
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LEMMA  11.  Suppose  that  (3*),  (T*)  have  a  atrlc  tly 
monotonic  solution  ^*.  Then  the  value  of  the  generalized 
survival  game  exists  and  Is  equal  to  ^*(Tq). 


Proof .  Relative  to  a  particular  play  of  the  generalized 

survival  game,  define  krt  -  0  and  let  k  ,  be  the  first  k  (if 

0  n+1 

any )  such  that  r^  +  r^  •  The  subsequence  fs  "l  •  j r^  .  is  finite 

n  \  J  In. 

in  length  if  and  only  If  jr^j  converges.  We  now  describe  a 

"local  recursive  f-optimal  ^•—strategy"  for  player  I;  It  reaenibles 
our  previous  "local"  strategies,  but  is  based  on  elementary  re¬ 
cursive  games  Instead  of  matrix  games.  Choose  a  sequence  of 
positive  numbers  fcg,  ,  t^,  ...  with  sum  £.  Let  player  I 
begin  by  playing  an  ^-optimal  strategy  of  the  elementary  re¬ 
cursive  game  [m(^*,  r^),  ^(Tq)]  •  If  and  when  that  strategy 
runs  out  (after  moves,  in  fact),  let  him  continue  with  an 
^—optimal  strategy  of  (m(^#,  s^),  P*(s1)],  and  so  on.  In  general, 
on  his  (kn+l)Bt  move,  he  will  be  commencing  an  t^-optlmal  strategy 
of  [H(K  sn),  F#(sn)).  We  wish  to  show  that  such  a  strategy, 
played  against  an  arbitrary  strategy  of  player  II,  causes  {rkj 
to  converge  with  probability  one. 

as  follows: 

is  defined  through  1  -  n, 
stops  at  1  -  <  n . 


Define 

the 

infinite 

sequence  ^x^ 

x^ 

" 

[**<•„> 

lf  W 

n 

|P*(.n  ) 

L  o 

lf  W 

construction  ensures 

that,  for  n  - 

B 

{** 

1  *n— l  ’ 

•••'  *o}  ^  *n-l 

n— 1 


P-022 

lO-JO-Co 

-X>- 


Therefore  th »  sequence  xQ,  x2+^)+tV  V  fcl+ ^  *  etc  . 

is  a  bounded  semlmartlngale .  We  conclude  that  jxnj  converges 
with  probability  one,  with 

E{xoo  I  xo}  *  x0  -  *  • 

However,  cannot  converge  if  /a^V  does  not  stop  at  Borne  s^  , 

l  i  no 

since  the  s^  oscillate  and  1®  strictly  monotonlc .  Hence 

Xqq  “  P*(»n  )  -  ?•(  lim  r^)i  and  we  have: 
o 

e[f*(11hi  rk)|  >  J#(rQ)  -  t. 


The  rest  of  the  proof  is  obvious. 

We  now  particularized  F*(r)  to  be  F(r)  +  e(r-R-A),  where 
Ms  a  positive  constant  and  A  -  max|a^j|.  (Compare  section  2.) 
Using  the  same  initial  function  as  before: 


If  r  <  R 

if  r  2  R, 

we  generate  a  sequence  -  ^T**'4q|  by  iterating  the  new 

tranaformatlon  T*,  given  by  (7*).  The  next  lemma  corresponds 
to  lemma  3 • 


tyr)  -  ♦j(r)  - 


t(x^-R-A) 

1  +  t ( r-R—A ) 


r  t-  i  r _ n .  _  ^ 


LEMMA  12.  If  valila^Ji  £  0,  and  il'  "vQ  is  not 
continuous  at  R,  then  for  sufficiently  small  fc  the 
sequence  Just  defined  converges  to  a  strictly  mono- 

tonic  solution  of  (7*) i  (^*) • 


Tfte  proof  is  essentially  the  same  as  the  proof  of  lemma  S. 
TYie  substitution  of  elementary  recursive  games  for  matrix  games 
causes  trouble  only  at  one  spot:  the  proof  of  .  The 
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difficulty  is  resolved  by  an  appeal  to  the  following  fact:  p  2  0 
and  val | I :0 1 |  0  together  imply  that  val  (m,  p)  2  0 • 

LEMMA  1> .  If  both  Vq  and  F  have  Jumps  at  R, 

then  so  does  v^. 

Proof .  We  use  the  fact  that  v^  Is  a  solution  of  (T),  (¥) . 

As  in  the  proof  of  lemma  11,  we  can  find  a  "local  recursive 

optimal  "vQ-etrategy "  for  player  I  that  ensures  that  the  sequence 
(as  defined  there,  but  with  F  for  F*  and  for  $*)  converges 
with  probability  1,  and  that 

B{xoo  I  xo}  *  W  -  1  ■ 

This  holds  for  any  strategy  of  player  II;  we  shall  consider  a 
particular  one.  By  lemma  3  the  Jump  In  vQ  means  that  | la^jll 
has  a  set  of  columns  that  meets  each  row  In  a  subrow  that  contains 
a  negative  element,  ox  Is  all  zero.  The  same  strategy  for  player 
II  used  In  the  proof  lemma  3#  part  B,  guarantees  a  probability 
2  s  ■  S  >  0  that  ^r^j  will  never  increase,  'nils  means 

that  with  probability  2  will  converge  to  a  limit  r  ^  rQ  <  R. 

Hence 

K(xoo  1  xo}  i  h  -  6>  +  b-P(R-)- 

This  bound  is  <  1  because  of  the  Jump  in  F  at  R,  and  la  Indepen¬ 
dent  of  Tq.  Thus,  letting  t— >  0  we  find  that  Vg(r0)  is  bounded 
away  from  1  for  0  <  <  R,  ss  was  to  be  shown . 

Proof  of  theorem  3 .  There  le  no  loss  of  generality  In 
assuming  val||a^j||  2  0*  The  theorem  is  trivial  if  v^  la  con¬ 
tinuous  at  R,  sinoe  then  v^  -  v1  by  lemmas  2  and  3,  so  we  can 
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aasume  that  Vq  haa  a  Jump  at  R.  Assume  for  the  moment  that  F 
also  haa  a  Jump  at  R.  Then,  applying  lemmas  1}#  12,  and  1 1  in 
that  order,  we  find  that  the  F*  games  all  have  values  as  £->0. 

The  uniform  convergence  ensures  that  tne  original  game  also  haa 
a  value,  and  it  is  clear  that  this  value,  being  the  limit  of  the 
F#  values,  is  independent  of  $.  On  the  other  hand,  if  F  is 
continuous  at  R,  then  we  can  approximate  it  uniformly  by  a 
sequence  of  discontinuous,  monotonic  functions.  The  preceding 
argument  applies  to  the  latter,  and  passing  to  the  limit  completes 
the  proof . 


COROLLARY.  Equations  (5)»  (^)  have  a  unique 
solution,  assuming  only  that  F  is  monotonic  and 
satisfies  (4). 

Proqf .  Let  4  be  any  solution  of  (5),  (*0  and  consider  the 
game  determined  by  F,  $,  with  ^5*1.  A  "local  recursive  e-optlmal 
4-fltrategy n  for  player  I  (see  proof  of  lemma  II )  will  guarantee 
him  an  expected  payoff  of  at  least  4(Tq)  -  fc  in  this  game.  Thus: 

v(rQ)  >  4 ( Iq ) , 

if  v  la  its  value  function.  But  v  is  also  the  value  function  of 

t 

the  game  defined  by  $  e  0,  by  theorem  lj .  By  symmetry  we  have: 


v( V  ^  *(ro) • 

Thus  4  I®  uniquely  Jetenrlneu. 
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b.  APPROXIMATIONS  AND  BOUNDS  FOR  THS  VALUE  FUNCTION 

In  this  aection  we  extend  to  games  of  survival  some  of  the 
known  results  for  random  walks  with  absorbing  barriers — i  .e  . , 
the  gambler's  ruin  problem  (see  [7],  chapter  14).  The  random 
walk  on  (0,  R)  with  each  step  determined  by  the  fixed  random 
variable  $  leads  naturally  to  a  functional  equation,  highly 
reminiscent  of  our  fundamental  equation  (3)  t 

(13)  4(r)  -  E^(r+$)}  ,  0  <  r  <  R. 

It  is  satisfied  by  several  functions  associated  with  the  random 
walk;  among  them  is  the  probability  pR(r)  that  a  particle  start¬ 
ing  at  r  will  reach  R  before  it  reaches  0.  This  "absorption" 
probability  lu  uniquely  determined  by  (13)  and  the  famlli  ir 
boundary  condition  : 

(M  4(r)  -  P(r),  r  £  0,  r  >  R; 

assuming  that  £  is  not  identically  0. 

If  It  happens  that  K|f|-  0,  then  (13)  has  among  its  sol¬ 
utions  all  linear  functions  A  ♦  Br.  Applying  the  two  conaitions 
pRC0)  ■  0  ana  pR(R)  -  1  we  get  A  -  0  and  B  -  1/ft,  or 

Pp  0  <  r  <  R. 

this  la  not  exact  because  the  particle  will  in  general  be  absorbed 
beyond,  not  at,  the  barriers  0  and  R.  Taking  this  fact  into 
account,  we  obtain  rigorous  estimates! 

<  PR<r> 


r 

R 


» 


0  <  r  <  R, 
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where  M  and  are  such  that,  always  — f  <  -x'  . 

If  on  the  other  nand,  K^j  +  0,  then  there  will  be  a  unique. 


nonzero  A^  aucn  that 


dM 


r  V 


4  } 


i. 


provided  that  ^  takes  on  both  positive  and  negative  values 

with  positive  probability  (see  [?] ,  page  >02,  or  [  1 : ]  ,  page 

264).  Then  (13)  hts  among  its  solutions  all  functions  of  the 

\)r 

form  A  +  Be  .  As  before,  this  leads  tc  an  approximation 


PH(r) 


.v . , 

"  7?^ 


0  <  r  <  R 


and  bounds  j 


-1 


Aq  ( r+A*) 

5  pR(r)  C  “^(R+m) 


-  1 


0  <  r  <  R. 


-  1 


The  linear  case  first  discussed  (with  »  0)  corresponds 
to  A  •  o.  Actually,  It  Is  not  an  exceptional  case;  this  becomes 
evident  If  we  Introduce  the  function  f: 


f(A,  x) 


(e*x  — 1  )/a 
)  x 


If  A  |  0 
If  A  -  0  , 


which  Is  continuous  and  monotonic  increasing  in  A  for  each  x. 

The  relation  (14)  defining  Aq  becomes  e|i  (Aq,  \  )|  -  0,  which 
has  a  unique  solution  In  all  cases.  Write  P(x)  for  f(V  *). 

Then  the  approxijxiat Ion  and  bounds  for  p^  are  olmply  P(r)/P(R), 
F(r)/F( R+v)  and  F( r-M-‘)/F(R-fA-L) ,  respectively,  regardless  of  whether 
Aq  Is  positive,  negative,  or  zero. 


P— o22 

10-10— tjb 

-,35— 

Por  games  of  survival  we  have  some  very  similar  resilts: 

LEMMA  14.  If  !  I aij 1 t  *s  zero— free  and  If 

max  min  a.  ,  <  0  <  min  max  a.  , , 

1  J  J  1  1J 

then  there  la  a  unique  number  Aq  such  th^t 
(lb)  val | |f(AQ,  u1J)| |  -  0. 

Moreover,  Aa  and  val||a, ,|j  have  oppoalte  algna,  or 

U  1 J 

are  both  zero . 

Proof .  Ttie  value  of  |jf(A,  a^)||  18  a  continuous  and 
strictly  Bono  tonic  function  of  A,  since  none  of  the  a^j  is  0. 

This  function  tends  to  the  limit  ♦  go  as  A-»  ♦  oo  because  of  the 
positive  element  in  each  column,  and  to  the  limit  -  go  as  A  ->  _co 
because  of  the  negative  element  In  each  row.  Therefore,  it  has 
precisely  one  zero.  The  last  part  of  the  lemma  follows  from  the 
fact  that  val  |  |  f  (0,  8^)11  -  val||aiJ||. 

Again  write  P(x  )  for  f (Aq,  x). 

L MU  15.  F  is  a  solution  of  (}). 

Proof .  Using  the  identity  (valid  for  all  A): 

**(*#  x+y)  -  x)  +  e**f(A,y), 

val |  | F( r+a^ ^ )  1 1  -  F(r)  ♦  e  0  v«l|  |F(»1J)  |  | 

-  F(r) 


we  have : 
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as  re^uii'ej.  Th“  corollary  which  fallows  is  proven  by  trie  same 
device  . 


COROLLARY .  Th  »  local  F— strategies  are  precisely 
tnose  mixed  strategies  that  use  only  probability  dis¬ 
tributions  that  are  optimal  In  tne  matrix  gome  J  |  F  ( a  -  1 )  j  |  . 

•  v 

THEOREM  o.  If  j ]a.  ,| |  1b  zero— free  ana  If 

max  min  a.  4  <  0  <  a, In  max  a.  4 
1  *  l 

w  1  * 


then  the  value  of  the  survival  cane  is  approximately 
e jual  to  P(rQ)/P(R).  More  precisely,  we  have: 


(10) 


F<*0> 

P(R  +  v) 


<  v(rQ)  < 


P(rQ  ^  ^ 


) 


P(R  + 


f 


where  -v'  -  aax  a.  ,,  -nin  a,  The  local  ?— strategies 

1  j  1  J 

are  a;  ,  reximately  optimal,  in  tne  sense  tnat  player  1  can 
enforce  the  lower  bound  of  (iu),  anu  player  II  the  upper 
bound,  by  using  them. 

We  remark  that  an  all— positive  row  (max  min  a.  ,  >0)  or  an 
all-negative  column  (min  max  a.  ,  <  0)  trivializes  the  game  • 

(These  cases  correspor.u  to  -  — oo  and  +or  respectively.) 

Proof  of  theorem  u.  Denote  the  lndl  -tea  lower  bound  in 
(lu)  by  ^.{Vq)  .  Clearly  5  Is  a  st.ictly  monotonic  solution  of 
(d),  and  the  local  F— strategies  are  also  local  g— e trategles • 

If  we  set  p*(r)  -  g(r)  for  r  outslae  (0,  R)  we  have  a  "generalized 
survival  game"  In  tne  sense  t  **  section  d-  By  leuuna  4,  g(i’Q)  la 


p -Jjj'j 

i  0-  i.  0— -p  j 

-3J  - 

its  value,  ar.d  t.ie  local  F— at  rate*  gle 3  ore  optima^.  Bat  P*  <  P 
throughout  the  relevant  intervals  {-A*-,  0]  and  [R,  R+  ^ ) ;  tnvre- 
fore  ^Tq)  <  v("q)»  una  the  local  F— strategies  enforce  at  least 
the  lower  amount  for  player  I.  The  otner  bound  13  established 
in  the  same  way . 

The  bounds  (io)  con  so:  .e times  be  improved  by  exploiting 
special  nro;er'tius  of  t  ne  matrix.  For  ex  u..;  le  ,  inadmissible 
rows  or  columns  of  ||F(a^)||  con  be  uiaregarueu  l.n  calculating 
^  and  is  .  Twu  other  soon  results  are  the  following: 

COROLLARY  1.  If  r q,  R,  n 1  the  a^  ,  ore  ill 
integers,  tnen  u  anu  v'  In  (lu)  :n  y  be  re;  lace  i 
by  1  ana  V- :  respectively. 

COROLLARY  2.  If  and  R  are*  Integra  and  tne 

are  all  1  1,  then  the  valu:  of  tne  rune  Is  exactly 
P(.-0)/?(R),  and  the  local  R— e trateg ies  are  optimal. 

An  equally  eoact  result  holds  for  arbitrary  ana  R;  it  na3 
the  fonn  v(Tq)  -  ?{ r^+  ^  )/F(Rh  /*  +  >  ) ,  where  —  a*  and  h+  v  are 
the  unique  absorption  points  of  the  process.  However,  a  ana  Z 
depend  on  Tq  In  such  u  way  tnat  v  i3  actually  a  step  function, 
despite  the  continuity  of  F. 

Two  simpl°  asymptotic  results  are  of  Interest: 

COROLLARY  J> .  If  R  — >  ao  with  rQ  held  fixed,  tn« 
value  of  the  game  tends  to  a  limit  -t  that  is  -  0  or 


satisfies 
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depend  ing  or.  whetner  vai!|a^,||  <  0  or  >0. 

Thus,  If  the  "money"  game  la  In  nis  favor,  player  I  can  defeat 
even  an  arbitrarily  rich  opponent,  .vita  3o:ne  probability. 


COROLLARY  4 . 

If  Tq  and 

R  — g  oo 

In  a 

fixed 

ratio , 

or,  equivalently. 

If  tne  a, . 

1  j 

all  — >0 

in  a 

fixed 

ratio , 

ther  the  llir.it  of 

v(rQ)  is  e 

1  trier  0, 

rc/R' 

or  1 

,  depending 

on  whetner  valj  |a,  j  |  <  0,  -  0,  or  >  0,  respectively. 

As  we  pass  to  tne  limit  in  tn  la  faanlon,  the  "naive"  strategy 
of  maximizing  the  minimum  expecteu  money  gain  on  each  round 
becomes  better  ana  better.  T:ae*-i,  in  the  balance  j  ca3e 
(va^|la.  ,||  ■=  0)  It  1 3  a  local  F-stru\.egy ,  ana  In  the  lopslue,. 

^  xj 

cases  (val||u.  ,||  <  0  or  >  0)  one  player  has  nothing  to  lose 
anyway,  in  the  limit,  while  any  strategy  with  positive  expected 
gain  wins  Hr  the  other.  Theae  remarks  may  clarify  tne  retner 
puzzling  (arid  nut  entirely  correct)  conclusions  of  [l]  ,  [f]  ,  [  1 1  ] 

to  the  effect  tn it  tne  "naive"  strategy  Just  mentioned  13  approxi¬ 
mately  optimal. 

[The  following  is  on  example  of  a  game  in  which  the 

"naive"  strategy  Is  not  satisfactory.  In  fact,  If  player 

1  f  O  1  lO  W3  it 


Example  10 


P— u22 
1 0— 1 0 — '  0 
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here  he  will  always  choose  the  first  row  and  hence  always 
lose  (assuming  0  <  £  <  )  .  Another  case  where  the  "naive" 

strategy  is  not  satisfactory  for  player  1  is  given  by  example 
7  above  .] 

A  generalization  of  corollary  4  has  been  obtained  by  Scarf 
[l2]  for  survival  games  in  which  r  ana  a.  ,  are  n— dimens lonal 

v 

vectors.  Under  certain  assumptions,  which  reduce  to  our  condi¬ 
tion  val||a.  .  | |  =  0,  he  finds  that  the  limiting  vaiue  functions 

^  J 

are  generalized  harmonic  functions,  being  the  zeros  of  certain 
second— order  differential  operators,  in  general  nonlinear. 

A  different  extension  of  the  survival  game  model,  of  some 
interest,  is  obtained  by  changing  the  inform^t ion  pattern,  dis¬ 
rupting  in  some  specified  way  the  process  whereby  the  players 
learn  of  each  other's  past  moves  and  the  resulting  winnings  or 
losses  (see  [l4] ) .  Since  the  local  P— strategies  can  be  playeu 
without  benefit  of  any  Information  whatever,  the  bounds  of 
theorem  6  remain  applicable,  and  we  have: 

COROLLARY  •  In  a  game  of  survival  with  i-estricted 
Information  flow,  the  value  (if  It  exists)  lies  within 
the  bounds  (lb).  In  any  case,  the  minorant  (sup— inf)  ana 
majorant  (inf— Bup)  values  exist  and  satisfy  (lb). 

We  note  in  passing  that  the  value  always  exists  if  Q  *  0  or 
Q  *  1,  since  the  payoff  as  a  function  of  the  pure  strategies  is 
semlcont lnuous ,  and  the  pure  strategy  spaces  are  como« 0 t ,  regard¬ 
less  of  the  information  pattern  (compare  [l  j>]  )  . 

So  far  in  this  section  we  nave  been  proceeding  on  the  assump¬ 
tion  that  |  | , | |  is  zero— free  .  We  now  indicate  without  proof 
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the  modifications  re  .uired  if  tnia  assumption  la  dropped.  The 
parallel  numbering  will  assist  comparison. 


LEMMA  1-4°. 
tne  solutions  o 


If  max  min 


<  0  <  min  max 

J  1 


then 


(13°)  val| | f (A,  a  ) ||  -  0 

constitute  a  finite,  closes  interval  [X1,  V].  Moreover, 
A'  and  A"  botn  h^ve  3igna  opposite  to  vui||a.  .  ||,  and  ,ve 
have  A1  0  <c^  A  li  and  only  11  va  HU.. M  -  o: 

^  J 


Write  F'(x)  for  f(A',  x)  an  1  P"(x)  for  f(A",  x)  . 


LEMMA  1-A .  Both  P1  and  P"  are  solutions  of  (3)- 

COROLLARY.  The  local  P’-  and  P"-etrategles  are  pre¬ 
cisely  those  mixed  strategies  tnat  use  only  probability 
distributions  that  are  optimal  in  the  matrix  paries  ||P'(a^,)|| 
and  ||P"(a^j)||  respectively. 

THEOREM  0°.  If  max  min  a,  .  <  0  <  min  max  a. ,  then 

.  1  J  <  4  1  si 

1  v  si  U 

the  extreme  solutions  an  1  of  (}),  (4)  are  approximated 
by  P" (r )/P" (R)  and  P'(r)/P'(R)  respectively,  with  precise 
bounds  of  the  form  (10).  In  the  Q  -  0  game,  player  II  can 
enforce  tne  upper  bound  to  v^  by  playing  v  local  P"— strategy , 
and  player  1  can  enforce  to  within  any  6  >  0  of  tne  lower 
bounu  by  choosing  6  >  0  small  enough  ana  playing  optimal 
strategies  of  ||f(A‘'+6,  u.,)j|  on  each  round.  A  similar 

J 

statement  holds  for  the  Q  •  1  game  and  its  value  function 
v..  Por  general  Q  the  value  (if  it  exists)  lies  between 
Pn  (r0)/Pn(R+ v)  ar.u  P'  ( rf/~)/F'  (R+/~)  . 
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Agaln  we  remark  that  the  cases  max  min  a,  4  >  0  and  min  max  a 

i  J  J  J  i 

are  trivial.  A  guide  to  what  happens  when  one  or  both  la  e^ual 
to  zero  la  provided  by  lemma  j>,  in  section  2. 

•file  five  corollaries  are  unchanged  or  are  rnociifled  in  the 
obvious  way,  using  the  last  part  of  lemma  14°  and  noting  that 
statements  must  be  made  in  terms  of  Vq  and  v ^ ,  with  the  value  of 

the  game  in  general  (if  It  exists)  lying  in  between.  Corollary 

o 

2  can  be  extended  slightxy  (with  the  aid  of  theorem  2)  to  yield 
the  following  result: 


< 


THEOREM  7.  If  the  are  ail  ±  1  or  0,  and  if 
A'  -  A",  then  vq  "  vi  t^e  v;i^ue  of  the  survival 
game  exists  and  is  independent  of  Q. 

It  1s  natural  to  ask  whether  A'  -  A"  implies  vQ  -  v  under 
more  general  conditions.  In  view  of  example  11,  discussed  below, 
the  answer  seems  to  be  in  the  negative  .  However,  the  converse 
Implication  Is  valid  almost  always.  In  fact,  if  A'  <  A"  then 
the  lne^uadity : 

*"(ryO  <  g'tr)  - 

P"{R+/*)  P'(R+v) 

holds  at  r  •  R/2  if  R  is  sufficiently  large.  This  implies 
Vq(R /2)  <  v^R/2)  by  theorem  b°  .  This  proves: 

THEOREM  8.  If  ||a. ,||  is  such  that  the  functions 
Vq  anu  v1  are  identical  for  large  values  of  R,  then 
A'  -  A"  . 

(To  see  that  the  condition  on  R  is  needed,  go  back  to  example  2 
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<  0 


In  section  1  and  put  R  *  1.  Then  we  dive  Vq  -  v  *  l/2  In  (0,  R); 
however  A'  <  0  <  A"  . ) 

[in  our  final  example,  It  Is  easily  checked  that 
valjla^jl  |  -  0  and  that  A'  •  XH  •  0 .  To  snow  that  vQ 
ani  v,  are  different,  let  u*  and  u"  be  the  value  functions 
for  the  survival  games  which  correspond  to  the  submatrlees : 


respectively.  Clearly,  >  max [u 1 ,  u"]  anu  <  mln[u',  u"]  . 
However,  a  simple  calculation  shows  that  u'  and  u"  are  uls— 
tine t  for  R  >  1;  hence  vQ  and  v,  are  also  distinct.] 
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